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Abstract 

We study the best exponential decay in the blocklength of the prob- 
ability of error that can be achieved in the transmission of a single bit 
over the Gaussian channel with an active noisy Gaussian feedback 
link. We impose an expected block power constraint on the forward 
link and study both almost-sure and expected block power constraints 
on the feedback link. In both cases the best achievable error expo- 
nents are finite and grow approximately proportionally to the larger 
between the signal-to-noise ratios on the forward and feedback links. 
The error exponents under almost-sure block power constraints are 
typically strictly smaller than under expected constraints. Some of 
the results extend to communication at arbitrary rates below capacity 
and to general discrete memoryless channels. 

1 Introduction 

This paper studies error exponents for the Gaussian channel with noisy feed- 
back. Unlike our previous work, which focused on passive feedback pQ, [2], 
[3], here we focus on active feedback. Thus, the time- A; symbol Uk fed to 
the feedback channel need not be the time-/c received symbol it can be 
a function of Y k and of the previous received symbols Yi, . . . , Y&_i. As in 
our previous work, we consider only transmission schemes of a deterministic 
blocklength n. (Random transmission times for discrete memoryless channels 
with active feedback are discussed in pQ.) And, although some of our results 
extend to more general models, we focus on the Gaussian model where both 
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Figure 1: The Gaussian channel with a coded noisy feedback link. 



the forward channel and the feedback channel are additive white Gaussian 
noise channels. To simplify the analysis we focus on the case where the mes- 
sage to be transmitted is binary, i.e., takes on the values and 1 equiprobably 
(but see ( PT3l) which is applicable to all rates of communication between zero 
and capacity). Our communication scheme is depicted in Figure [U 

Critical to our analysis is the precise nature of the power constraints that 
are imposed on the forward and feedback channels. On the forward channel 
we impose an expected block power constraint, where the time-average of the 
squared channel inputs is a random variable (whose realization may depend 
on the message and on the realization of the forward and feedback channels) 
whose expectation (over messages and the noise sequences on the forward and 
feedback channels) is upper-bounded by some fixed (deterministic) positive 
constant P; see ()8]) ahead. For the feedback link we consider two types of 
power constraints: an expected block power constraint (([9]) ahead) and an 
almost-sure block power constraint ( ( fTUl) ) . In the latter, the time- average of 
the squared inputs to the feedback channel must not exceed Pfb irrespective 
of the message and of the channel realizations. Clearly, an almost-sure power 
constraint is more restrictive than an expected power constraint. 

We do not consider an almost-sure block power constraint on the forward 
channel because under this constraint even a noise-free feedback link does 
not improve the two-codewords error exponent [5J, [BJ. 

Our main result is that — although a noise-free feedback link allows the 
probability of error to decay faster than exponentially in n [7] [8] [9] — if the 
feedback link is noisy the probability of error cannot decay faster than expo- 
nentially. This is true even if we only impose an expected block power con- 
straint on the feedback link. Moreover, we provide upper and lower bounds 
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on the best achievable exponent both for expected and almost-sure block 
power constraints. At high signal-to-noise ratios (SNRs) on the feedback 
link, the error exponents in both cases grow as an affine function of the SNR. 
A more formal statement of the results will be give in Section [2] once we have 
formalized the problem's statement. 



2 The Problem Statement and Main Results 

We consider the transmission of a single bit H, where H takes on the values 
and 1 equiprobably. Let the sets X, y, U, and Z all be the reals. A 
blocklength-n code for transmitting H over our channel consists of a forward- 
channel encoding rule, a feedback-channel encoding rule, and a decoder as 
described next. A forward-channel encoding rule is specified by n functions^ 
/i,...,/ n , where 

f k : {0,l}xZ k ~ l ^X, k = l,...n. (1) 

It is understood that the time- A; channel input X k is computed according to 
the rule 

X k = f k (H,Z k ~ l ), k=l,...,n, (2) 
where we use A to denote A%, . . . ,A# and where, for convenience, we set 

Z = 0. (3) 

The feedback-channel encoding rule is a collection of n functions g±, . . . , g n , 
where 

g k -.y k ^U, k = l,...,n. (4) 

It is understood that the symbol U k that is fed to the feedback channel at 
time k is given by 

U k = g k (Y k ), fc = l,...,n. (5) 

(The special case where g k (Y k ) is Y k corresponds to passive — also knows as 
"uncoded" or "symbol- by-symbol" -feedback.) 

A decoder is a decision rule for guessing H based on Y n . Thus, 

0:^-{O,l}. (6) 



1 All functions from R to R in this paper are assumed to be Borel Measurable. 
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We denote the decision regions by V and T>i so 



V u = {yey n :<P(y) = u}, v = 0,l, (7) 

where we use a to denote the n-tuple (ai, . . . , a n ). 

The communication system that we consider operates as follows. The 
message, along with the forward and backward channel noise components, 
H, Ni, . . . , N n , V\, . . . , V n , are independent random variables, where ~ 
jV(0, a 2 ) and V& ~ A/"(0, <r| B ) for every k G {1, . . . , n}. We assume through- 
out that er and <tfb are strictly positive. At time k, the input Xk to the 
forward channel is generated according to This input is corrupted by 
the forward channel noise, yielding the forward- channel output Yk = Xk+Nk. 
The feedback-channel encoder now computes the symbol Uk from Y k accord- 
ing to ((Sj). The symbol Uk, which forms the time-k input to the feedback 
channel is corrupted by the feedback-channel noise to yield = Uk + Vk at 
the output of that channel. The conditional density w(yk\xk) of Yk given Xk 
is thus 

1 _ (yk~ x k)' i 
w{y k \x k ) = , e ^ , x k , y k G R, 



V2 



TXO 
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and the conditional density w-p-Q{zk\Uk) of Z k given Uk is 

( z fc-"fc) 2 

w F B(zk\u k ) = —, == e 2ct fb , z fc ,w fc GM. 

V 27r(J FB 

We only consider forward- channel encoding rules that satisfy the expected 
block power constraint 



r n 

E 



k=l 



< nV, (8) 



where P > is some given constant designating the allowed average power 
(per transmission) on the forward-channel. 

For the feedback-channel encoding rules we consider two types of power 
constraints. An almost-sure block power constraint 

n 

Y^9l{y k )<nV FB , Y G y n , (9) 

k=l 
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and an expected block power constraint 



k=l 



< n? FB . (10) 



In both cases we assume that Pfb is strictly positive. (The case where Pfb = 
corresponds to the no- feedback case.) We can now present our main results. 
Almost-Sure Block Power Constraints: Let Pg S (P/cr 2 , Pfb/o"fb5 n ) de- 
note the least probability of error that can be achieved by a blocklength-n 
coding scheme subject to the almost-sure constraint (Q. We show in Sec- 
tion H that 



and we present in Section [5] a sequence of codes that proves that 
i p op 

lim — logpr (P/a 2 ,P FB /^ B ,n) > — + (12) 

71— ^oo W ""FB 

It is shown in Section H] that (fTTj) generalizes to the case where there are 
more than two codewords. If we denote by R the rate of communication, i.e., 
the ratio of the logarithm of the number of messages to the block length, and 
if we denote by Ep^(R) the best achievable error exponent then 

Epx(R) < E No fb(-R) H — ^ FB 9 FB ^ FB , (13) 

^FB 

where E'noFb(-R) is the reliability function of the forward channel in the ab- 
sence of feedback. 

Expected Block Power Constraints: Let ]?g Xp (P/cr 2 , Pfb/o"fb; n ) denote 
the least probability of error that can be achieved by a blocklength-n coding 
scheme subject to the expected block power constraint (1101) . We show in 
Section [6]that| 

lim" --log^ xp (P/(7 2 ,P F B/(7 FB) n) < 

2 



(Vp+^+v/p) (V Pfb + <x FB + v/TVb" 



+ " -2 ( 14 ) 



° 2 ^FB 



2 Section[6]also presents a tighter bound than (TT4 
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and we present in Section [7| a sequence of codes that achieves 



i op op 

lim — logC P (P/^,PFB/^ B ,n) > — + -P-. (15) 



3 Some Preliminaries 

Fix some code, and consider its use for transmitting the bit H over our 
channel. Let X denote the forward-channel inputs that result from such use 
through (j2J). Similarly define the forward-channel output sequence Y, the 
feedback-channel inputs by U, and the feedback-channel outputs by Z. Let 
P denote the joint law of X, Y, U, Z induced by the coding scheme, and let 
p(y, z) denote the joint density of Y, Z. Let the conditional versions of the 
joint law and density given H = be denoted by P and po(y, z). Similarly 
we use Pi and pi(y, z) when the conditioning is on H = 1. Thus 

n 

Pu(y,z) = YlPu{y k ,z k \y k -\z k - 1 ) 

k=l 
n 

= W{vu{yk\y k -\z k ^)p v {z k \y\z k ^)) 

k=l 

n n 

=t[ w (vk\fk{ v ,* k ~ 1 )) n«to(*kWi/*)) 5 ^=°' 1 ' ( ie ) 

k=l k=l 

where the last equality follows from our assumption that both the forward 
and feedback channels are memoryless and that the noise components of these 
channels are independent. Since H takes on the values and 1 equiprobably 
we have ^ ^ 

p(y,z) = 2^o(y,z) + 2^i(y' z )' ( 17 ) 

and the probability of error P (error) can be expressed as 

P(error) = - P (error) + — Pi (error) (18) 

= 1 -P (YeV 1 ) + 1 -P 1 (YeV ). (19) 
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Figure 2: The new channel in which Z is generated at random. 

4 Inachievability under A.S. Power Constraints 

The derivation of ffTTj) is based on a new reference channel that we define 
next. 

4.1 A Reference Channel 

We consider a new channel in which the forward- channel encoder, feedback- 
channel encoder, and channel decoder are as above, but in which the sequence 
z that is fed to the forward-channel encoder is generated independently of H 
according to some law Q; see Figure |2j Later we shall assume that this law 
is the marginal law P(Z) that is induced by the original channel and code. 
We denote the density of this law by q(z). Thus, the new channel operates 
like the original channel except that the sequence z that is fed to the channel 
encoder is not the output of the feedback channel but rather a randomly 
generated sequence drawn independently of H according to q(z). We denote 
by Q the joint distribution of H, X, Y, and Z that results when the original 
forward- channel encoder (T5]) is applied as in Figure [2j Thus, if we factorize 
the marginal law of Q on Z n as 

n 

q( Z )= nQz^-xW** -1 ) ( 2 °) 

k=l 

then 

Q(Z k = z k \Z k - x = z k -\Y k = y k ,H = u) = Qz^A^' 1 )- ( 21 ) 

(Under Q the sequence Z is generated "without looking at Y." Nevertheless, 
Z and Y are not necessarily independent under Q because Y is influenced via 
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the forward-channel by X, which in turn is influenced by Z via the forward- 
channel encoder.) 

The conditional laws of Q conditional on if = and H = 1 are denoted 
by Qo, Qi. Similarly, the unconditional and conditional joint densities of 
Y, Z are denoted by g(y, z), g (y, z), and qx(y, z). 

Note that according to Q the random sequence Z is generated indepen- 
dently of the hypothesis H, so 

g (z) = gi (z) = g(z). (22) 

Also, 

n 

Qu(y,z) = T[q v ((yk,Zk)\y k ~ 1 ,z k ~ 1 ) 

k=l 

n n 

= n^(^|y*,^- 1 )II^(y*|y*- 1 ,^- 1 ) 

k=l k=X 
n n 

= J\q(z k \z k - 1 )\[w{y k \f k {v,z k - 1 )) 

k=l k=l 
n 

= q(z) JJ w (y k | f k (u, z k ~ 1 )) , v = 0, 1, (23) 
fc=i 

where the first equality follows from the chain rule; the second from another 
application of the chain rule; the third from (|2"T|) ; and the fourth from the 
chain rule. 

The importance of the reference law is that the set-up of Figure [2] is no 
better than the no-feedback set-up. And since antipodal signaling is optimal 
in the absence of feedback, 

Q(error|z) > qU ^^ ^(M^+ELi /fcCM*" 1 ) ^ z G Z n . (24) 
4.2 Relating Q and P 

We next try to relate the original law P and the reference law Q. By (1161) 
and it follows that 

Pv(y,z) = r(y,z)g„(y,z), v = 0, 1, (25) 
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where 

r(y,z) = — . (26) 

In order to lower-bound P(error) in terms of Q(error), we need a lower 
bound on r(y,z). We derive one for the choice of Q(z) as P(z). Henceforth 
we thus assume 

g(z)=p(z), zeZ n . (27) 

It follows from (126]) and (I2T1) that in order to lower-bound r(y, z) we need to 
upper-bound p(z). To that end, we first use (fTBl) to express p u (y, z) as 

n n 

p„(y,z) = JJw FB (2fc|ufe) n^t^k* -1 '^" 1 )' ( 28a ) 
fc=i fe=i 

where 

u k = gh(y k ~ 1 ), k = l,...,n. (28b) 

For a fixed z 6 i? n , the second product on the RHS of (I28ap is a probability 
density function that integrates to one over the set of all sequences y G y n 
that, via (128bl) . induce u sequences satisfying 



1 n 

-X>* <Pfb- (29) 



n 

k=l 



Since the average is upper-bounded by the maximum, we obtain 

Pu(z) = J p„(y,z)dy (30) 

n 

< max J|wFB(2fcK), (31) 



u 

fe=l 



where the maximum is over all the sequences u e £Y n that satisfy 

Using the explicit form of the Gaussian distribution and the Cauchy- 
Schwarz Inequality we obtain 



p„(z) < max (27tcTf B ) " /2 exp (--^(||zf - 2 (z,u) E + ||u|| 2 ) 

l|u|| 2 <nP FB V ^FB 

< max (27r<jp B ) "^expf — (||z|| 2 — 2 ||z|| ||u|| + ||u|| 2 ) 

Hull <nPi?T3 



v ■> vil z ll - ll u ll) 2 

||u||"<nP PB ^ ^FB 



max (2tt<t fb ) ex P ( — 7T~2 

u|| 2 <nP PB V 2fXp 

= (2 7 r4 B )- n/2 exp(-^l-((||z||- v ^P^) + ) 2 ^ ^ = 0,1, (32) 

where £ + denotes the larger of zero and £, i.e., max{0,£}. Since f )32|) holds 
for both v = and v = 1, we can average over z/ to obtain 



p(a) < (2vra| B )- n/2 exp JL((|| Z || - v^) + ) 2 ) 



(33) 



We continue to lower-bound r(y,z), which is defined in ( 126]) by lower- 
bounding the numerator using (Q. Again, using the explicit form of the 
Gaussian distribution and the Cauchy-Schwarz Inequality we obtain 

n . 

X\wFB(z k \g k (y k )) > (27r^ B )- n/2 exp (-^-(IMI + V^VbT) (34) 



k=l 



Combining (125]) . CT. (153]) . and AM]) we obtain 

2 llzll a/^Pfb 



r(y,z)>expl g 1, ||z|| > nP FB , (35) 

V °~FB ' 

and 

r(y,z) > exp (-_L(|| Z || + y^nP^) 2 ) (36) 

FB 

> exp f T^-n), llzll 2 < nP FB . (37) 

These two inequalities can be combined to yield 



r(y,z) > exp f 2 ^M A^VTOV^ ^ z e ^ (3g) 
\ °"fb ' 



Consequently, by (|25l) 



p,(y,z)> 9 ,(y,z)exp( ^ m ^" Z "/^ V ^^^ n), z e 3». (39) 

V ^FB ^ 

Note that the RHS of (|38[) is monotonically decreasing in ||z||. 
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4.3 Lower- Bounding the Probability of Error 

Fix some e > and 5 > smaller than 1/2. Define 

P = Pfb + 4b + (40) 

Note that 

P > Pfb- (41) 

By the almost-sure block power constraint on the feedback channel (J9j), 
it follows that there exists some positive integer n (which depends on the 
choice of e) such that for any code of blocklength n exceeding no 

P(B) > 1 - 6, (42) 

where 

B = {z e Z n : ||z|| 2 < Pn}. (43) 

By Markov's inequality and by the expected block power constraint on the 
forward channel ©, it follows that for any code the subset A of Z n consisting 
of those sequences that cause the transmitted symbols on the forward link 
to have an average power that does not exceed P/ (1 — 2e), i.e., the set 



k k=l k=l J 



(44) 



satisfies 

P(A) > 2e. (45) 
It follows from (g5]) and (02]) that 

P(^ni3)>e. (46) 

Recalling (I4ip and the monotonicity of the RHS of (|38l) . we conclude that 
for z G B we can lower-bound r(y, z) by 

r(y,z)>e- Qn , zeB, (47a) 

where 

a = 5 . (47b) 
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We can now lower-bound the conditional probabilities of error as follows: 
Pi(YeP )=/ Pi(YGl?o|Z = z)j9 1 (z)dz 



> / P 1 (YeP |Z = z) Pl (z)dz 
JAnB 

= / Pi(y,z)dydz 
JAnB JVo 

= [ [ I{y Gl?o}pi(y,z)dydz 
JAnB Jy n 

= / I{y G T> } r(y, z) ?i(y, z) dy dz 

>e" an / / I{y GDo}gi(y,z)dydz 

= e- an [ [ I{y Gl?o}gi(y|z)g 1 (z)dydz 
./.4nB Jy n 



e -an 



[ p(z) / I{y Gl?o}gi(y|z)dydz. (48) 
./.4nB 



Similarly, 



Po(Y G > e- an [ p(z) / I{y G £> x } gb(y|z) dy dz. (49) 

Averaging (1481 and (1451 over the uniform prior of if we obtain 
P (error) 

= ^P 1 (YGP ) + ^Po(YGP 1 ) 

> e- Q " / p(z) f 1 / I{y G © }gi(y|z) dy + ± / I{y G X>i}g (y|z)) dy 
./.Ans \ A Jy n A Jy n J 

_ e ~an / p(z) Q(error|z) dz 
JAnB 

^^<\/S)L/ (Z)dZ 



>ee~™Q[J - ^ P I, m) 



(1 - 2e)a< 
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where the first line follows from our assumption that the prior is uniform; 
the second from and the third because under Q the hypothesis 

H is independent of Z; the fourth from fl24|) and because for z G A the 
transmitted energy is bounded by nP/(l — 2e) (jSJ); and the fifth line from 

in}. 

It follows from floDl) and from the definition of a (I47bl) that 

--logP c a ' s ' (P/a 2 ,P FB /a FB ,n) < + L ? 9 , 2 - 

Since e and <5 can be taken as small as we wish, and since by (HOI) 

'2 



lim/3(5) = P FB + cr FB , 

<5|0 



we conclude that 



lim" -ilogpr (P/- 2 ,PpB/4 B ,n) < V(Pfb + ^ b )P fb + 1_P ; 
n->oc n v 7 cr| B 2 

thus establishing ffTTj) . 

Note: The lower bound on the error probability in the case of almost-sure 
block power constraints easily extends to the case of many codewords. In 
this case one typically denotes the message by M instead of H. The analysis 
goes through with hardly any change to show that at any rate R, the error 
exponent E FBjeLS (R) with an almost-sure block power constraint is upper- 
bounded by 

e FBa . s .(R) < e NoFB (R) + 2 v / ( Pfb + ^b)Pfb ; (51) 

^FB 

where ^noFb(-R) is the reliability function of the forward channel in the ab- 
sence of feedback. 



5 Achievability under A.S. Power Constraints 

We next describe a sequence of codes that proves (|T2l) . 
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5.1 The Scheme 

Fix some < 5 < 1. At time-1 we send the message using antipodal signaling: 

f+v^VP iftf = 0, 

{-V^TV? hh = i. y ' 

At the subsequent (n — 2) times k — 2, 3, . . . , n — 1 the transmitter is silent 

X fc = 0, fc = 2,3,...,n-l. (53) 

Based on the sign of Yi, the receiver forms a tentative decision on i7 and 
feeds it back via the feedback link using antipodal signaling: 

i£i-,<o. 1 ' 

The encoder chooses the time-n transmitted symbol X n based on H and 
Zi, . . . Z n -i as follows. If 



^ n— 1 

— V Z fc > + V / P^(1 - 5) and if = 0, (55) 

71 — 1 z — ' 



k=l 



then the transmitter assumes that the tentative decision that the receiver 
made based on Yi is correct and it sends nothing at time n, i.e., it sets 
X n — 0. Likewise, if 



_ rt— 1 

— <- v / P^(l-5) and ff = 1, (56) 

fc=i 



then the transmitter sets X n = 0. In all other cases we say that a re- 
transmission event Re-Tx occurred and the transmitter retransmits the mes- 
sage using antipodal signaling with a huge instantaneous power, i.e., by send- 
ing X n = ±a/P/7, where 7 is the probability of retransmission (which we 
shall soon see is exponentially small). Thus 

f + J?h if (n - l)- 1 YXX z * < v / P^(l - S) and H = 0, 
Xn=l-^Vh if(n-l)- 1 E^i 1 ^.>-v / P^(l-5)andif = l, (57) 
[0 otherwise. 
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To make its final decision, the receiver considers Y n and compares it to a 
threshold T. (We shall later choose T to equal the blocklength n.) If Y n > 
Y, then the receiver assumes that a retransmission took place and decides 
"if = 0." Similarly, if Y n < — Y, it assumes that a retransmission occurred 
and decides "if = 1." Otherwise, if \Y n \ < T, it decides that a retransmission 
did not take place and that its tentative decision was correct: it declares 
U H = 0" if Y ± > and declares "H = 1" if Y x < 0. If if denotes the final 
decision, then 



H 



if Y n > T or if (jy n | < T and Y x > o) , 

1 if F n < -T or if f|y n | < T and Yi < oV 



(58) 



5.2 Analysis 

It is straightforward to see that the expected average transmitted power on 
the forward link is P and that with probability one the average transmitted 
power on the feedback link does not exceed Pfb- We focus on the probability 
of error. We shall assume throughout that H = 0; the analysis of the case 
where H = 1 is very similar. When H = 0, a retransmission occurs if the 
event 

S = {^fl Z ^^ 1 - 5 )) ( 59 ) 

^ k=l ' 

occurs. Substituting the event {Yi > 0} for A and Q for B in the inequality 

Pr(AuB) <Pr(B\A) + Pr(A c ), Pr(A) > (60) 

yields that the conditional probability of a retransmission P (Re-Tx) is upper- 
bounded by 



Po(Re-Tx) < Pr 



^ n— 1 

— J2z k <V?(l-5) 
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By a similar argument, one can show that this also upper-bounds the prob- 
ability of retransmission conditional on H = 1. Thus, 



T= P(Re .Tx) < Ql^EM) +a ( (63) 



a / \ cr F B 



Notice that for a fixed 5 > 0, it follows from (1631) that 7 tends to zero 
exponentially in n. Consequently the amplitude yP/^y in the retransmission 
phase is much larger than the noise variance, and, in fact, the ratio 



^ (64) 



a 

grows exponentially in n. If we now set T = n, then the probabilities 



Pr[|Y n | >T\X n = 0] (65a) 



Pr[Y ft <T|X„ = VP/7] (65b) 

and 

Pr[Y n >-r\X n = -y/?fa] (65c) 

will all decay faster than exponentially to zero. We conclude that the prob- 
ability that a retransmission takes place and a decoding error occurs decays 
faster than exponentially in n. Thus, 

liminf logPr[Re-Tx and error] = +00. (66) 

The dominant error that will determine the exponential decay of the proba- 
bility of error of our scheme is thus the probability that a retransmission does 
not take place and an error occurs. As before, this event does not depend on 
the hypothesis by symmetry. If H = 0, then the event that no retransmis- 
sion takes place and yet an error occurs is equivalent to the tentative decision 
being wrong 

{Y n < 0} (67a) 
and the transmitter not realizing this 

rt-l 

' (67b) 



^ k=i ' 
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The latter two events are independent and thus 



n 

P (no Re-Tx and error) = P ((n - ly 1 ^Z k > v / Pfb(1 - 5)) Po(*i < 0) 

k=2 



e ' Z {2 ~ s) ) Q v^ ] - (68) 

An analogous expression can be derived conditional on H = 1 to conclude 
that 

P(no Re-Tx and error) = Q [ V ^^ (2 ~ ^ Q ( ^^ ) ■ (69) 

Combining fl69l) with fl66l) demonstrates that our scheme achieves an error 
exponent of 

i_p 

2<r 2 2 *Tpg • 1 ' 

By considering the limit of 5 j we obtain that any exponent smaller than 

P +^ PI) 



2a 2 <j| B 



is achievable. In fact, by letting S tends to zero very slowly with n, we can 
achieve the exponent (I7T1) and thus establish (fl"2l . 

6 Inachievability under Expected Power Con- 
straints 

In this section we prove ffMl) . We begin with some definitions. 
6.1 Some Definitions 

Given ai, at2 > and some blocklength-n coding scheme, we define the set 

n 

T 9 ={yef: llyf < na?, ^(l/*) < nai}. (72) 



fc=i 
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Notice that the set T y depends on a 1; a 2 , the blocklength n, and the feedback- 
channel encoding rule under consideration, but our notation does not make 
this explicit. 

Given /3i , /?2 > and some blocklength- n coding scheme we define 

n 

Tj°) = |z G Z n : ||z|| 2 < nPl £tf (0,**- 1 ) < nft). (73) 

k=l 

This set depends on j3i, @2, the blocklength n, and the forward- channel en- 
coder under consideration. 

6.2 Preliminary Lemmas 

We present here some lemmas that will be useful in proving ([14]) . 
Lemma 1. The following inequality holds: 

Pi(y) < (2n<r 2 r n/2 , yey n . (74) 

Proof. By ^ 

n n 

Pl (y,z) = Hw{y k \f k {l,z k ^)) \{pi{z k \y\z k - 1 ) (75) 

k=l k=l 

n 

< (2na 2 )- n / 2 l[p 1 (z k \y k ,z k - 1 ), y G y n . (76) 

k=l 

For a fixed y E y n the product 

n 

IlpiWy*,**- 1 ) ( 77 ) 
fc=i 

is a density on Z n . Integrating (j7B"|) over z we thus obtain 
Pi(y) = / Pi(y,z)dz 

< (27ra 2 )-"/ 2 / \\ Pl {z k \y k ,z k - l )d2, 

Jzn k=i 

= (2na 2 )- n / 2 , y G y n . □ 
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Lemma 2. The following inequality holds: 

Po(z) < (27r4 B )-"/ 2 , z G 

Proo/. By (USD 

n n 

fe=i ^=1 

n 

< (27r ( x| B )-"/ 2 nPo(2/ fc |/ fe (0,^- 1 )), z G Z». 
fc=i 

For a fixed z G Z n , the product 

n 

npoUi/fc(o,^ _i ; 



k=l 

is a density on y n . Integrating over y we thus obtain 

Po(z) = / p (y,z)dy 
Jyn 

< (2na 2 FB )- n / 2 [ flpoUlfk&z*- 1 )) dy 



'* n fc =i 

2 s-n/2 



= (2tt^ b )-"/ 2 , zgZ" 
Lemma 3. The following inequality holds: 



po(y,z) > (47rVa 2 B )-"/ 2 exp(-n( 



(«i + /3 2 ) 2 + (/3i + « 2 ) ; 



2a 2 2<x| B 



'-yi " c 

Proof. By f fT6|) we note that 



Po(y,z) = JI^W/aC ' 2 * V 1I"'™(^I//a-(//') 



k=l k=l 
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and we proceed to lower-bound each of the products separately for y e T y 
and z e T} \ For such y and z we have 

n / . n 

II w {Vk\h (0, z k - 1 )) = (2vra 2 r n/2 exp - — £ (2/. - /* (0, z"' 1 ) ) ' 

k=l \ k=l 



1 



> (27r<r 2 ) ~™ /2 



exp 



2a 2 
1 



\ fc=i 



2(T 2 



f0 2x-n/2 / (Ol+WA 

= (2ttct ) ' exp I -n — 1. 

We next turn to the second product. For y and z as above 

n / 1 " 2 \ 

Y[w FB (z k \g k (y k )) =(27ia 2 FB )- n / 2 exp{-^-^Y,( z k-9k{y k )) 

k=i V FB k=i J 



(83) 



> (27ra 2 B )- n/2 exp 



2^b 



\ fc=i 



> (27ra 2 B )- n / 2 exp 



24b 



1 / \ 2 

Vn/?i + v^«2 



(27ra 2 B )-"/ 2 expl -n 



{ Pi + a 2 y 

24b 



Inequalities (1841) and (1831) combine with ( 1821) to prove the lemma. 
Lemma 4. TTie following inequality holds: 

\2, 



(84) 
□ 



Po(y)>(27ra 2 )^/ 2 exp(-n( 



(«i + /? 2 ) 2 (A + a 2 )' 



2a 2 



24b 



Po(Z G7?°>), 

ye^ (85) 
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Proof. For every y G T y we have 

Po(y) = / Po(y,z)dz 

> / , n Po(y,z)dz 

Jri 0) 

where the last inequality follows from Lemma [3], i.e., from (1ST)) . It remains 
to lower-bound the volume of Tg as follows: 

iri 0) sup zg7; (o)Po(z) 
Po(Z GTj 0) ) 
" (2vr4 B )-^ ' 

where the last inequality follows from Lemma [2, i-e., from (1751) . □ 
Lemma 5. TTie following inequality holds: 

^ M >exp^(^-^ + ^- | ^jjP (ZGT()) ) yer s . (86) 

Proof. Follows from Lemma H] and Lemma [U, i.e., from (185]) and (|74p . □ 
Lemma 6. TTie following inequality holds: 

P,(Yer,nP,) > 

exp (_„(^i±M + <^£))p„(z 6 t(«))p i( y 6 r s n (87) 

Proof. This follows from Lemma [6], i.e., from (1ST)) as follows: 
P (YGT,nI? 1 ) 

/" Po(y) / 

y^m?! Pi(y) 

> exp (_„((^^ + W_^)!))p o(Ze7 ;(o» ) / Pl(y)dy 

V V lo Za FB y / JT y nv 1 

= -pH^ + ^))p.(z^)P 1 (v 6 r.n Dl ). □ 
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6.3 A Proof of JEJ) 

We now use Lemma [6] to prove (fT4l) . Suppose we are given a sequence of 
codes, with a code corresponding to each blocklength n. To establish (j!4p 
we need to show that from every subsequence {n^} of blocklengths tending 
to infinity we can extract a subsequence {n' k } such that 

FB + 0"fb + V^FB 



lim log P (error, n' k ) < , 

k^oo n k a A <jp B 

(88) 

where P(error, n' k ) denotes the probability of error of the code corresponding 
to the blocklength n' k . We refer to this as "our claim" and proceed to prove 
it. We thus start with some subsequence {n^} and proceed to prove the 
existence of a subsequence {n' k } tending to infinity for which fl88|) holds. 

Before proving our claim we make several reductions. We first assume 
that the subsequence {n^} is such that 

lim P„(Y e Z>„) = 1, v = 0, 1. (89) 

There is no loss in generality in making this assumption because otherwise 
we can pick {n' k } to be a subsequence for which for some v G {0, 1} the limit 
as n' k — > oo of P„(Y G V v ) is not 1, in which case the LHS of flHBl zero and 
hence trivially smaller than its RHS. 

Before stating the second reduction we introduce some notation. For a 
given sequence of codes indexed by the blocklength-n, we define for every 
blocklength n 



P^ = -E 



n 



k=l 



E = v 



i/ = 0, 1, (90) 



where fx, . . . , f n are the mappings that define the forward-channel encoder 
of the code indexed by n. (The dependence of the encoding mappings on 
the blocklength n is omitted for brevity.) Note that by the block power 
constraint (jHJ) 

+ Pi 1} < 2P, n = l,2,... (91) 

The second reduction we make is in assuming that the subsequence {n^} is 
such that the limits defining P^ -* and P^ as 

pM=limPW i/ = 0,l (92) 

k— *oo K 
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exist and satisfy 



p(o) + p(i) < 2 p. 



(93) 



There is no loss in generality in making this assumption because the more 
general case where the above does not necessarily hold follows from the less- 
general case by applying the less-general result to the subsequence of {rik} 
which we denote by {n' k } and which we define as follows. We pick a sub- 
sequence {fife} of {nfe} for which the limit of P- ^ exists; we call the limit 
P' '; we define the subsequence {n' k } of {nk} — and hence also of {rik} — as 
a subsequence of {n^} for which the limit of P~, also exists; and we finally 

define P^ as this limit. We then observe that (193]) then follows from (l9Tj) . 
Finally, we define for every blocklength n 



E 

fc=i 



9l(Y k ) 



H 



0,1, 



(94) 



where g\, . . . , g n are the mappings that define the feedback-channel encoder. 

v = 0,l (95) 



We now assume that the limits defining Ppg and Pp B as 



>(«0 



FB 



lim P 



exist and satisfy 



FB,n fc ' 



p(0) , p(l) < p 
K FB + K FB S " FB- 



(96) 



This entails no loss of generality by arguments analogous to those we used 
for the second reduction. 

We are now ready to prove our claim subject to the above assumptions. 
Let e > (smaller than 1/2) be fixed. Choose 



a. 



01 
01 



l 2(p(D +(T 2 )(1 + e) 



,(o) 



6?(Pffi + «fB)(l + c) 
6^(1 + 6), 



(97) 
(98) 
(99) 
(100) 



where the positive numbers ai, a 2 , b\, and b 2 satisfy 



- + -<! 



(101) 
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and 



1 1 



(102) 



Let the sets T y and T^ be as denned in ( 1T2"]) and ( 1731) . Using the bound 

Pr(„4 n B) = Pr(.A) + Pr(£) - Pr(.A U B) > Pr(.A) + Pr(£) - 1 
and Markov's inequality we obtain 



n 

P a (Y G T y ) = Pi(||Y|| 2 < naf, ^^(F fc ) < nag) 

fc=i 

>Pi(||Y|| 2 <na?)+P 1 (^^(y fc )< 



> 1 



E|||Y|| 2 |//=J] ] E \n=i9l(Y k ) 



- 1 

H = 1 



naf 



p(i) 



a 



FB,n 

On 



71= 1,2, 



It follows from (pi . (195|) . and (11011) that for all sufficiently large n fc 

Pi(ygt v )>|. 

From this and (|89p we can infer that for all sufficiently large 



(103) 



Pi(YeT y nz>i) > -. (104) 

By similar arguments we can show that for all sufficiently large ilk 

P x {YeT^)> e -. (105) 
From Lemma [6] we then have 



Po(error) = P (Y G £>i) 

> P (Y G T y n £>i) 



> -e 2 exp^— 



(«i + /9 2 ) 2 (A + a 2 ) 5 



2<X 2 



2^ B 



(106) 
(107) 

(108) 
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Since e can be chosen as small as we wish, we conclude that no error exponent 
higher than 



Et = inf 



ai,a,2,bi, b 2 ) 2cr 2 2a FB 

is achievable, where the infimum is over all positive 01,02,^1,62 satisfying 
mm and pJBP . 

We could, of course, have also reversed the roles of H = and H = 1 to 
obtain that no error exponent higher than 

( (a.VW^ + b 2 V^Y (bJ?£l + al B + a 2 Jlfl 
E = inf < ± — J —+^^ 

ai,a 2 ,fei,fe 2 I 2a 2 2(Tp B 

is achievable. Thus, our best bound is 

sup min^!,^}, (109) 

p(0) p(l) p(0) p(l) 
r ' r ' FB ' FB 

where the supremum is over all positive P*- - 1 , P*- 1 -*, Pp° B , P FB satisfying fl93|) and 
(HI. 

A suboptimal choice for a±, a 2 , 61, &2 is 

ai = a 2 = &i = & 2 = V2 (110) 

which leads to 



i?i<i?r b = ^ 2 ^ + ^ - 2 — - — '—, (in) 



£ <£o ub = ^ - 2 '- + ^— 2Z. — (112) 



FB 



Opening the square and using fl93l) and fl96|) we obtain 



EP" 1 P P F B V( P(1) + Or2 ) P(0) V( P FB + ^B)P F B 



a' crf B a 2 a FB 



1 + - + + J 12 + J -2 • < 1 13) 
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and 

^(0) _L^ P (l) 



ET_^ _P Pfb V(P W + ^ 2 )P (1) V(P^ + ^b)P^ 

2 1 + a 2 + a 2 B + a 2 + 4 B ' (1Mj 

and the error exponent is upper-bounded by 

E suh 4 min{^ ub , £* ub }. (115) 

Now it is easy to see that the bound is maximized with P^ - 1 = = P and 
Pfb = Pfb = Pfb- Indeed, the error exponent is upper-bounded by 

_ E mh < -(Ef°/2 + E» uh /2) (116) 



p p FB iV( p(1) + - 2 ) p(0) iV( p(0) + ^) p(1) ^ 

cr 2 ct fb 2 cr 2 2 a 2 



2 <r FB 2 <7p B 



P Ppb V^ P(1) + (T2 ) P(0) + ^ P(0)+ ^ P(1) , ^ 

<1 + — + ^ + -^ = 119 

a 2 <7 FB cr 2 



v 2 \ FB ' °FB/ FB ' 2 ' FB ' °FB/ FB . . 

H -j (120) 



a FB 



1 P P FB yVP + P^pW V^Pfb + PM 

+ ^ + -|b - 2 ^FB { } 



<l + P + ^ + ^g + Vg%±3B (122) 

a 2 a FB a 2 a£ B 

(v / PT^+v / P~) (VP FB + 0"fB + VPfB ) 



2<x 2 2or 2 B 



(123) 



with equality if P (0) = P (1) = P and P F ° B = P^! B = P FB . Here the inequality 
(11201) follows from Jensen's inequality. 

We conclude from (11231) that the suboptimal choice (1 11 01) demonstrates 
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that the error exponent is upper-bounded by 



(124) 




Note that while the choice (IllOp is in general suboptimal, optimizing over 
ai, a 2 , bi, and b 2 cannot yield any bound lower than half the bound of (jl24|) . 
because ffTOTj) and ffT02]) imply that 



7 Achievability under Expected Power Con- 
straints 



We begin with the description of a "building block" comprising a transmission 
scheme upon which we shall build when coding under an expected power 
constraint on the feedback link. 

7.1 A building block 

The Scheme: The building block transmits a single bit, which we denote 
by H. Its parameters are the blocklength n, the transmitted average power 
on the forward link P > 0, the noise variances <T 2 ,cxf B > on the forward 
and backward links, and the average transmitted power on the feedback link 
A > 0. Note that A will not influence the error exponent of the building 
block. Consequently, when we later use the building block we shall typically 
choose A very small to save power. An additional parameter is some arbitrary 
(small) < 5 < 1. 

The key elements of the building block are transmission, ACK/NACK, 
and retransmission. The transmission is based on antipodal signaling to send 
the bit over n — 1 channel uses: 



ai, d 2 , &i, b 2 > 1. 




k — 1, . . . , n — 1. 



(125) 



The first n — 2 symbols sent by the receiver are zero 



U h = 0, fc=l,...,n-2. 



(126) 
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Based on the received symbols Yi, . . . , Y n _i, the receiver computes 



n-l 



5 = ^y fc . (127) 



fc=i 

If 



-5 



< (1-5)V?, 



n — 1 

then the decoder declares that a NACK event has occurred. Otherwise, it 
declares that an ACK event has occurred. It then uses XJ n -\ to tell the 
transmitter which of these two events occurred: 

fo if ACK . . 

C/ n _i = <^ . 128 

|v/A/P (NACK) ifNACK. v ; 

Notice that a NACK is a rare event of exponentially small probability: 
P (NACK) = P (-^ < (i-S)V? S j- P < -(1 - 6)V?j 



a /\/n — 1 / \ cr/yf', 



n 



S 2 P 



we"^" 1 )^, (129) 
and, by symmetry, 

Pi (NACK) = Po(NACK). (130) 

Based on Z n _i the transmitter guesses whether a NACK or ACK oc- 
curred. It does so by comparing Z n ^\ to some threshold T. If Z n _i ex- 
ceeds T, then the transmitter guesses that a NACK was sent. We refer 
to this event as a "NACK". Otherwise, if Z n _\ is smaller than T, then 
the transmitter guesses that an ACK was sent and we refer to this as an 
"ACK" event. The threshold T is chosen so that both P ( "NACK" | ACK) 
and P ("ACK"|NACK) decay in n to zero faster than any exponential, i.e., 

- lim ilnP ("NACK"|ACK) = +oo, (131a) 

n^oo Ti 

- lim -lnP ("ACK"|NACK) = +oo. (131b) 

n^oo n 
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In view of (11281) and (11291) . this can be accomplished, for example, by choos- 
ing T = n. 

The time-n transmitted symbol X n is now determined as follows. If 
"ACK" , then the transmitter sends the zero symbol; otherwise it re-transmits 
H using antipodal signaling with very large power. Thus, 

'0 if "ACK", 



X n = { + v / P/Po("NACK") if "NACK" and H = 0, (132) 
P/P ("NACK") if "NACK" and H = 1. 

Note that "NACK" has an exponentially small probability. (This follows 
because NACK is a rare event (11291) and because of (I13ip .) Consequently, in 
the symbol X n that is sent if "NACK" occurs have a huge magnitude 



so 

- lim -lnP (F n < 0|"NACK") = +oo, (133a) 

n— »oo Tl 

- lim -\nP 1 (Y n > 01 "NACK") = +oo. (133b) 

ra—>oo n 

We next consider how the receiver forms its guess H for H. If ACK, then 
the receiver guesses based on the sign of S. If NACK, then it guesses based 
on the sign of Y n . Thus, 

^ _ fo if (ACK and S > 0) or (NACK and Y n > 0), 

[1 if (ACK and S < 0) or (NACK and Y n < 0). ' ' 

Analysis: We next analyze the probability of error. Since the scheme is 
completely symmetric, it suffices to compute the conditional probability of 
error conditional on H = 0, namely, Po (error). We express this probability 

as 

<1 <1 exceedingly small by I ll33al 

P (error) = P (NACKfP ("NACK" |NACK)"P (error | NACK, "NACK" ) 

<1 exceedingly small by (1 13 lbl ) <1 

^ 



+ Po(NACK) P ("ACK"|NACK) P (error) NACK, "ACK"; 

<1 exceedingly small by H131al l <1 

+ P^ACrg P ("NACK"|ACK) v P (error|ACK, "NACK")' 

<i <i 

+ Pq(ACK) P ("ACK"|ACK) P (error|ACK, "ACK") 
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« P (error|ACK, "ACK") 

= P (error | ACK). (135) 
We next study P (error|ACK): 

P (error|ACK) = P (S < (n - 1) _1 |-S| > (1 - <J)Vp) (136) 



P ((n-l)- 1 5<-(l-5)v / P) 
P ((n-l)- 1 |5| > (1-5)V?) 



Q 



(2-S)VP 



(137) 



(138) 



Po((n-l)- 1 |,S| > (l-S)Vfj 

^ eXP (" n ^^)' (139) 

Since 5 > can be chosen as small as we want, we conclude from (11351) and 
( 11391) that the building block we described can achieve any error exponent 
smaller than 

Vr (140) 

In fact, if we allow for 5 to tends to zero very slowly with n, we can even 
achieve this exponent irrespective of how small A > is. 

7.2 The Proposed Scheme and its Performance 

The scheme: The proposed scheme has three phases: a transmission phase, 
an echo phase, and a re-transmission phase. To simplify the exposition we 
shall assume that the blocklength n is odd and define 

v=\{n-l). (141) 

(To code for an even blocklength n we can use the proposed scheme for n — 1 
and then append a zero symbol to the transmission.) Fix some < A < 
min{P, Pfb} (later to be chosen arbitrarily small). 

In the transmission phase we use the building block of Section 17.11 to 
transmit H in v channel uses using power 2P — A on the forward link and 
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power A on the feedback link. We denote the receiver's guess of H after this 
phase by H'. By ffTO and (fHIl) we have 



P (#' ^H) = Pt (H' ^ #) « exp (- n — 5— J . (142) 

In the echo phase we use the building block of Section ED to send H' from 
the receiver to the transmitter. We thus think of the original feedback channel 
from the receiver to the transmitter as the forward channel in the building 
block, and we think of the original forward channel from the transmitter 
to the receiver as the feedback channel in the building block. The receiver 
uses power 2Pfb — A and the transmitter uses power A. We denote the 
transmitter's guess for H' at the end of this phase by H" . Substituting in 
(11401) 2P FB — A for P and <rf B for a 2 we obtain that 

P (H" + H') = P 1 (H" + H') « exp (~n 2?FB ~ A ) . (143) 

Note that by (TT42T) and fTM 

P (H" = 0,H' = 1) = Pi [H" = 1, H' = 0) 

/ /2P-A 2P FB -A\\ , i 

« exp ^_„(_ + ^ ? _)j. (144 ) 

In the final re-transmission phase which comprises of one channel use, the 
transmitter compares H and H". If they are equal, it sends the zero sym- 
bol. Otherwise it re-transmits H using antipodal signaling with amplitude 
y/?/P (H"^H): 

{0 if H" = H, 

+ y /P/P (H"^H) if (H,H") = (0,1), (145) 
-y/?/P (H»?H) if (H,H") — (1,0). 

At the end of the re-transmission phase, the receiver makes its final guess 
H of H. It does so by comparing Y n to a threshold T: 

f if Y n > T, 
# = I H' if |y n | < T, (146) 

(i ify n <-T. 
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Notice that by (j!44p the amplitude y/P /Pq{H" ^ H) is exponentially large, 
so there is no difficulty finding a threshold T (e.g., T = n) such that 



lim — In Pr 



\Y n \ > T 



X„ = 



-oo, 



lim — In Pr 

n^oo Ti 



Y n < T 



— lim — In Pr 



Yn > "T 



X n = v / P/Po(^ ,/ + H) 
X n = - v /?/P (H"^H) 



-oo, 



-oo. 



(147a) 

(147b) 
(147c) 



Analysis: We shall analyze the probability of error conditional on H = 0. 
It is identical to the one given H — 1. 



negligible by Ill47aj l <1 
a ^— 



Po(error) = P (error | H" = 0, H' = 0) P (H" = 0, H' = 0) 



<i 



+ P (error |#" = 0, H' = l) P (H" = 0, H' = l) 

negligible by l|147b| l <1 

A A 



+ P (error |#" = 1, H' = 0) P Q (H" = 1, H' — 0) 

negligible by l|147b| l <1 
, * w * , 

+ P (error |#" = 1, H' = l) P (#" = 1, H' = l) 

« p (#" = 0, if' = 1) 

/ /2P-A 2P FB -A\\ . , 

wexp -n( — + ^ , (148) 

\ \ a cr FB // 

where the last approximation follows from (11441) . By symmetry, Pi (error) = 
Po (error), so (11481) implies that the error exponent 

2P-A + 2P FB -A 



(X 2 (7 



FB 



is achievable. Since, A can be chosen arbitrarily small, it follows that any 
exponent smaller than 

2P 2Pp R 



® ^FB 



is achievable. In fact, if we let A tend to zero very slowly with n, we can 
achieve the error exponent ( 11501) . 
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8 Summary and Possible Extensions 



We presented results on the best achievable error exponents in transmitting 
a bit over the Gaussian channel with an active noisy Gaussian feedback link. 
(In the case of an almost sure block power constraint on the feedback link 
we also obtained an upper bound on the error exponent for arbitrary rates of 
communication; see (|5ip .) We have shown that even if both the forward link 
and the feedback link are subjected to expected block power constraints, 
the best error exponents are finite. Roughly speaking — irrespective of the 
nature of the feedback power constraint — the best error exponent is roughly 
proportional to the larger of the signal-to-noise ratio on the forward link P/cr 2 
and the signal-to-noise ratio on the feedback channel Pfb/cfb- In this very 
rough sense, active feedback is not much different from passive symbol-by- 
symbol feedback [2]. 

However, a more careful analysis based on our previous result [H [2] shows 
that the best error exponent for two messages with passive (symbol-by- 
symbol) feedback is upper-bounded by 



On the other hand, an achievable error exponent (11501) for an active feedback 
with the same feedback signal-to-noise ratio is 



Hence, the freedom to code over the feedback link can at least quadruple the 
error exponent of binary communication. It would be interesting to see how 
much active feedback gains over passive feedback for a positive rate R. 

While our focus has been on Gaussian channels with Gaussian feedback 
channels, some of our techniques are more general. For example, consider 
a setting where the forward and feedback channels are binary symmetric 
channels (BSCs) with crossover probabilities e, e F B < 1/2. In this case we 




(151) 



which can be further upper-bounded by 




(152) 
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can apply the technique of Section @] (with the sets A and B being {0, l} n ) to 
obtain that the reliability function with noisy active feedback cannot exceed 

In 1 " 6 ™ + E NoFB (fl; e), (153) 

e FB 

where E No fb(R] e ) is the reliability function of the BSC of crossover proba- 
bility e. 

In some cases, particularly when the feedback channel is very noisy, this 
bound can be tighter than the trivial bound that bounds the reliability func- 
tion by that with perfect feedback and bounds the latter by the best two- 
codeword error exponent 

-In— r. (154) 

2 4e(l-e) V ; 

(The fact that feedback does not improve the best two-codeword error ex- 
ponent on a discrete memoryless channel appears in the Ph.D. thesis of 
Berlekamp [10J who attributes this result to Gallager and Shannon.) 

The bound in (11531) complements the recent work of Burnashev and Ya- 
mamoto [TT] on the reliability function of the binary symmetric channel with 
a passive binary symmetric feedback link. (Upper bounds on the latter reli- 
ability function can be derived using techniques similar to those we used in 



References 

[1] Y.-H. Kim, A. Lapidoth, and T. Weissman, "On the reliability of Gaus- 
sian channels with noisy feedback," in Proceedings Forty-First Allerton 
Conference on Communication, Control and Computing, pp. 364-371, 
September 2006. 

[2] Y.-H. Kim, A. Lapidoth, and T. Weissman, "The Gaussian channel with 
noisy feedback," in Proc. of the International Symposium on Information 
Theory (ISIT'07), (Nice, France), pp. 1416-1420, June 2007. 

[3] Y.-H. Kim, A. Lapidoth, and T. Weissman, "Bounds on the error ex- 
ponents of the AWGN channel with AWGN-corrupted feedback," in 
Proceedings of 24th IEEE Convention of Electrical and Electronics En- 
gineers in Israel, pp. 184-188, Nov. 2006. 



34 



[4] S. Draper and A. Sahai, "Variable-length coding with noisy feedback," 
European Transactions on Telecommunications, vol. 19, pp. 355-370, 
May 2008. 

[5] M. S. Pinsker, "The probability of error in block transmission in a memo- 
ryless Gaussian channel with feedback," Problems of Information Trans- 
mission, vol. 4, no. 4, pp. 3-19, 1968. 

[6] L. A. Shepp, J. K. Wolf, A. D. Wyner, and J. Ziv, "Binary commu- 
nication over the Gaussian channel using feedback with a peak energy 
constraint," IEEE Trans, on Inform. Theory, vol. 15, pp. 476-478, July 
1969. 

[7] J. P. M. Schalkwijk and T. Kailath, "A coding scheme for additive noise 
channels with feeback — part I: no bandwidth constraint," IEEE Trans, 
on Inform. Theory, vol. 12, pp. 172-182, April 1966. 

[8] A. J. Kramer, "Improving communication reliability by use of an in- 
termittent feedback channel," IEEE Trans, on Inform. Theory, vol. 15, 
pp. 52-60, Jan. 1969. 

[9] R. G. Gallager and B. Nakiboglu, "Variations on a theme by Schalkwijk 
and Kailath," \arXiv:0812.270$ v2, 16 August 2009. 

[10] E. R. Berlekamp, Block coding with noiseless feedback. PhD thesis, Mas- 
sachusetts Institute of Technology, 1964. 

[11] M. V. Burnashev and H. Yamamoto, "Noisy feedback improves the BSC 
reliability function," in Proceedings of the International Symposium on 
Information Theory ISIT'09, (Seoul, Korea), pp. 1501-1505, June- July 
2009. 



35 



